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Abstract 



Extreme shock models have been introduced in Gut and Hiisler (1999) to study 
systems that at random times are subject to shock of random magnitude. These 
systems break down when some shock overcomes a given resistance level. 

In this paper we propose an alternative approach to extreme shock models us- 
ing reinforced urn processes. As a consequence of this we are able to look at the 
same problem under a Bayesian nonparametric perspective, providing the predictive 
c/j , distribution of systems' defaults. 
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O ' 1 Introduction 

O ' 

Shock models are a particular class of models in which a system is randomly 
^ ■ subject to different shocks of random magnitude that can make it fail. 

In the literature (see j8] for a good survey) there are essentially two distinct 
types of shock models: cumulative shock models, in which the failure of the 
system is due to a cumulative effect; and extreme shock models, whose default 
is caused by one single extreme shock. In this paper we focus our attention 
only on the second type, referring to [6] for cumulative shock models. 
Consider a family {Zi, Ui} i>0 of nonnegative i.i.d. two-dimensional random 
vectors, such that Zj represents the intensity of the i-th shock and Ui is the 
time between the (i — l)-th and the i-th shock. Set Z = Uq = T = and, for 
n > 1, T n = Yh=i Ui is the amount of time that has elapsed after n shocks. 
In extreme shock models, one is interested in the behavior of the stopping 
time r (t) = min {n : Z n > t} , i.e. the minimum time at which a large extreme 
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shock occurs causing the default of the system at T Tt . We refer to [7] for further 
details and results. 

More recently, in [5], extreme shock models have been generalized by assum- 
ing that large but not fatal shocks may effect system's tolerance to subsequent 
shocks. To be more exact, for a fixed t, a shock Zi can damage the system 
if it is larger than a certain boundary value (3t < t. As long as Zi < t the 
system does not fail. The crucial hypothesis is the following: if a first nonfatal 
shock comes with values in [/3 t , t] the maximum load limit of the system is no 
more t, but decreases to a t (l) G [f3 t ,t], since the system has been damaged. 
At this point, if another large but not too strong shock occurs in [fit, att(l)], 
the new crucial threshold is lowered again to a t (2) G [/3f,at(l)] and so on 
until the system fails. We could call all this "risky threshold mechanism". 
The relevant stopping time is now r(t) = min {n : Z n > a t (L t (n — 1))} with 
Lt{n) = Yh=i l{Zi>/3 t } an d L t (0) = 0. All the results can be found in [5]. 
In this work we want to present an alternative perspective to extreme shock 
model by using a particular class of reinforced urn processes, as introduced 
by |12j . The aim is to develop a Bayesian nonparametric approach to shock 
models, in the wake of some recent works like [I]. As we will see the choice of 
using urn schemes for modeling is strictly related to their ability of reproduc- 
ing the Bayesian paradigm of information update in a rather intuitive way. 
In the literature there are very few papers that combine shock models and urn 
processes. In [11] a Polya urn is used to model a system subject to non-i.i.d. 
shocks, while in [1] a first urn-based approach to generalized extreme shock 
models is discussed. 

Urn processes form a very large family of probabilistic models in which the 
probability of certain events is represented in terms of sampling, replacing and 
adding balls in one or more urns or boxes. A good introduction to urn models 
and their properties is represented by (9] and [TO] . 

In reality it is not difficult to derive simple shock models using urns, as we 
only need basic tools as Bernoulli and Poisson trials. Think for example of a 
simple urn containing b black balls and w white balls, which is sampled with 
replacement. If black balls are associated to the event "extreme fatal shock" 
and white balls represent the case in which there is no dangerous shock, then 
the waiting time related to the extraction of the first black ball from the urn 
is somehow related to the r(t) in extreme shock models. 
Naturally, this is just a trivial example. A more interesting urn scheme has 
been proposed in [1] to model generalized extreme shock models, where a tri- 
angular reinforcement matrix is used to mymic the risky threshold mechanism. 
This model is called UbGesm (urn-based generalized extreme shock model) 
and, in the next sections, we will show how to obtain it as a special case of 
our new approach. 

Very briefly, having in mind the mechanism of generalized extreme shock mod- 
els, the idea is to create three different risk areas for the system subject to 
shocks - no risk or safe, risky and default, to link every area to a particular 
color and to work with the probability for the process to enter each area. 
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If every time the process enters the risky area the probability of failing in- 
creases, and this can be obtained with a triangular reinforcement matrix, we 
can consider such a modeling a sort of intuitive approach to generalized ex- 
treme shock models, getting around the definition of the moving threshold. 
In some sense, reinforcing the probability for the system to fail is like making 
the risky threshold move down and vice- versa. 

Consider an urn containing balls of three different colors: x, y, and w. The 
x-balls are related to the safe state, y-balls to the risky state and to-balls 
embody the default state. The process evolves as follows: at time n a ball is 
sampled from the urn, the probability of sampling a particular ball depending 
on the urn composition after time n — 1; then, according to the color of the 
sampled ball, the process enters (or remains in) one of the three states of risk 
(e.g. if the sampled ball is of type x, the process is in a safe state, while it fails 
if the chosen ball is w); finally the urn is reinforced according to its balanced 
reinforcement matrix, as shown in ([T]) . It means that if the sampled ball is of 
type x, then the ball is returned and s > extra x-balls are added to the urn, 
if the sampled ball is of type y, then it is replaced together with r > y-balls 
and p > w-balls, and if the sampled ball is of type w, then s extra to-balls 
are added. 



x 

RM = y 

w 



1 + 8 

1 + r p 
1 + s 



, where r = s — p 



The distributions of the different colors and the main properties of the urn 
process can be described analytically through the analysis of its generating 
function, as discussed in [T], where all the connections with standard shock 
models are also analyzed. 



2 Extreme shock models via reinforced urn processes 



The basic ingredient of our construction is the Polya urn, introduced by [5]. 
The behavior of this urn model is very simple yet ingenious. In its simplest 
version, we have an urn containing balls of two different colors. Every time 
we sample the urn we look at the color of the chosen ball and then put it 
back into the urn together with another ball of the same color. In this way, 
the more a given color has been sampled in the past, the more likely it will 
be sampled in the future. It is easy to understand how this naive replacement 
rule is able to reproduce a lot of self-reinforcing and contagious phenomena. 
More formally, at time t = 0, consider an urn U with initial composition 
C = (w ,b ), where w > and b > are the numbers of white and black 
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balls. At every time step t > 1, urn U is sampled and the extracted ball is 
replaced into it together with s > balls of the same color. Let X t be a 
random variable equal to 1 if the sampled ball at time t > 1 is black and 
whether the ball is white. It is clear that Xi ~ Bernoulli(Z ), where Z = 
bo/(wo + bo) is the proportion of black balls at time t = 0, and, for t > 1, 
X t +\ ~ Bernoulli(Zt), where Z t = b t /(wt + b t ) is now a random variable. It is 
not difficult to demonstrate that the sequence {X t }t>i is exchangeable in the 
sense of de Finetti [2]. 

Regarding the evolution of balls in the urn, we simply have 



Thanks to its reinforcement mechanism, Polya urn is widely used in Bayesian 
analysis (see for example [9] and [12]): the initial composition of the urn can 
be considered as the prior knowledge about the occurrence of an event; the 
sampling of the balls represents the outcome of the statistical experiment; 
and the reinforcement of balls can be seen as the Bayesian updating, whose 
strength is given by s, of the prior knowledge. 

Polya urns have a lot of interesting properties. For example, thanks to ex- 
changeability and de Finetti's representation theorem, conditionally on a ran- 
dom variable 0, the variables X t are i.i.d Bernoulli(&). Moreover, it can be 
shown that ~ Beta (w / s,b / s) and Z t — y a s _ 0. These are the essential 
properties for our approach to extreme shock models. We refer to [9] and [JU] 
for a much more complete treatment. 

Recently, in [12J, a generalization of the Polya urn scheme has been introduced 
under the name of reinforced urn process (RUP). Here we directly introduce 
our special case, referring to the next section for a more general setting. 
Imagine to have a discrete set of states v < vi < v 2 < ... and associate to each 
of them a Polya urn U(vi), i > 0. Every urn has its own initial composition 
C(vi) = (w(vi),b(vi)), for i > 0. 

A reinforced urn process {X n } on {vo,v\, ...} is defined iteratively as follows: 
set X = Vq and, for n > 1, if X n _i = sample urn U{yi). If the sampled 
ball is white, then Polya reinforce urn U(vi) with s > white balls and set 
X n = Vi + \. Otherwise, whether the ball is black, add s black balls and set 
X t = Vq. In other words, starting from urn U(vo) we sequentially sample from 
urns in Vq, V\, ... until a black ball is chosen, then we start again the se- 
quential sampling. 

Now, let black balls represent the event "extreme shock", while white balls 
indicate the event "no shock or weak shock" . Moreover, imagine for simplicity 
that the states vq < v± < v 2 < ... are just time instants, such that Vi = i for 
i > (please notice that this simplification is not necessary for the model to 
work and the states V{ can be of every kind). 

Repeating the iterative sampling several times, we obtain a sequence like this 




(2) 
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as realization: 



{X n } n >! = {v ,V 1 ,V2,V ,V 1 ,Vo,V 1 ,V 2 ,V ,V 1 , ...,v w ,v u ,v , ....} 

= {0,1,2,0,1,0,1,2,0,1,. ..,10,11,0,....} 1 j 

In other words, every time a black ball is sampled, a so called 0-block is 
created, i.e. a sequence of states between two different 0's. 
Now, assume we have several different systems, say k > 1, that are subjects 
to shocks as in the standard extreme shock model setting. Let us hypothesize 
that these systems are exchangeable, i.e. it is not relevant, for our analysis, the 
order in which we consider them. If the life of every system is represented by 
one of the 0-blocks, we have that the process {X n } is partially exchangeable in 
the sense of Diaconis and Freedman [3J. In other words {X n } can be expressed 
as a mixture of Markov chains. In fact, it suffices to notice that by assumption 
the 0-blocks are exchangeable (every block represents the life of a system) and 
every block is a Markov chain, since, within each block, the probability of 
moving from one state to the other only depends on the last visited state. 
Let £j be the last coordinate of the i-th 0-block, for i = 1, k, of the process 
{X n }. Since every is a function of the corresponding 0-block i, and the 
blocks are exchangeable, then the sequence is exchangeable as well. 
Now, in order to guarantee that the process {X n } is recurrent, i.e. P[X n = 
for infinitely many n] — 1, let us assume that 

iim n i h s Vi \, \ = o- (4) 

— L \ w(vi) +b(vi) 



n— >oo 

i 



In this way we are sure that infinitely many 0-blocks can be created and 
we can thus define the sequence {r n } of stopping times, with r = and 
r n = mf{n > r n _i : X n = 0}. Naturally, we have that £ n = X Tn _ x . 
Let us finally enter in the Bayesian interpretation of extreme shock models 
using reinforced urn processes. Consider the first system subject to shocks. 
All the information we have about the probability of an extreme shock in 
state vq = is just represented by the a priori information about the initial 
composition of urn U(vq) (remember that an extreme shock is represented by 
the extraction of a black ball). Hence we have that 

P(& = 0) = , f^,, r and P(£i > 0) = , r . (5) 

vs ; w(0) + 6(0) ^ ; w(0) + 6(0) v ; 

If a black ball is sampled and the system fails, then urn U(0) is reinforced 
with s extra black balls. Otherwise we add s extra white balls. For clarity we 
call the new reinforced urn 6 rl (0). From now on U l (v) and C i (v) represent the 
Polya urn and its composition in state v after the i-th sampling. 
If the system does not fail in vq, since we have extracted a white ball, we 
move to urn U(vi), and so on until we pick a black ball. View that we are 
considering the first system and we do not have any information about past 
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experiments, we simply obtain 



Now imagine that the first system fails in v r , i.e. at time instant r, then we have 
that C 1 (f r ) = (w(v r ), b(v r ) + s), C 1 (fj) = (w(vj) + s, b(vj)) for j — 0, r — 1 
and C l (vj) = C°(vj) for j > r. 

At this point we start considering the second system. We begin from the 
urn in state vq, that now has been updated according to the history of the 
first system, being f/ 1 (f ). Up to state v r we will use the information we have 
acquired about system one. From v r+ i on we will come back to the initial prior 
information, since no history has been observed. These iterative procedure is 
repeated for all the systems considered. We can then state the following result. 



Proposition 1 Given a reinforced urn process {X n } as described above, after 
observing m systems, we have that the probability that the (m + l)-th system 
fails in v r is equal to 

P( c _„it c \_ b(v r ) + sd r r ^ wiv^ + sfj 



w(v r ) + sf r + b(v r ) + sd r *J- Q w(vj) + sfj + b(vj) + sdj ' 

' ' ' (7) ' 
while 

> v r \^,...,u = n - , , (8) 

j=0 w i v j) + s fj + °( v j) + sd j 
where /, = E™=i !{«,<&} and d t = E™=i 1{^=? P }- 

Proof. The proof is simply given by applying the iterative construction of 
the process as for equation (jSJ) and by counting the number of defaults in the 
different states at every sampling. ■ 



As far as inference is concerned, from equations (0) and (E]), we derive that 

£ m+ l = £[£ TO+1 |£i, ...,Cm] = XX-P(6m+l = Vrlfl = Oi,...,^ m = CL m ). (9) 

r 

Anyway, the most interesting aspect of the reinforced urn process construction 
for extreme shock models is represented by the following proposition, that gives 
useful information about the distribution of default times. 



Proposition 2 If {X n } is a recurrent reinforced urn process, the sequence 
{£ n } is exchangeable, i.e. there exists a random distribution function F such 
that, conditionally on F, the random variables of the sequence {£„} are i.i.d. 
with distribution F, whose law is that of a beta-Stacy process. In other words, 
for v i+ \ G V , the random mass assigned by F to the subset {v ,Vi, ...,Vi + 1} 
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is equal to 



l-nV-^), (io) 

3=1 

where Y i} i = 1,2,..., are independent random variables such that Yi is dis- 
tributed as Beta(w(vi)/s,b(vi)/s). 

Proof. The proposition is an application of Theorem 3.26 in |12j . to which 
we refer for further details. The fact that Y iy i = 1,2,..., are independent 
Beta(w(vi) /s,b(vi) /s) random variables is a direct consequence of the use of 
Polya urns. ■ 

The beta-Stacy process has been introduced in [15] as a special case of neu- 
tral to the right processes (see [1]). An interesting property of beta-Stacy 
processes is conjugacy, that is to say that, in our construction, the poste- 
rior distribution for F, after observing the history of the different systems, is 
still a discrete time beta-Stacy process, with jumps in {v r } and parameters 
(w(v r ) + sf r , b(v r ) + sd r ). 

Example 

We now show a possible simple application of the urn-based shock model in 
the field of material science and engineering. 

Imagine we have several equal bars of the same metal and we want to test 
which is the maximum load that they can bear before rupture. A similar situ- 
ation can be efficiently modeled using the reinforced urn process we have just 
described. 

Set Vq < Vx < v 2 < ... to be different loadings in increasing order. Then equip 
every state Vi with an urn U(vi) as seen before. 

Start with the first bar and apply loading vq. If it cracks then read this as the 
extraction of a black ball from urn U(vq), reinforce the urn with s black balls 
and pass to the second bar. If the loading is not sufficient for the bar to break, 
we have sampled a white ball, we reinforce the urn and then move to loading 
V\ > vq. Finally we go on until the metal bar shatters. 

Repeating the procedure for the different bars we are able to make Bayesian 
inference about the loading capacity of the different bars (remember equations 
(J7J) and OH])). Calibrating the magnitude s of reinforcement, we can weight the 
information given to the experiment with respect to our prior knowledge, as 
expressed by the initial compositions of the different urns. 
This kind of model can be considered a special case of extreme shock model, 
in which the magnitude of shocks (loading) is not random, but it increases 
state after state. 
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3 The general construction and generalized extreme shock models 



The model we have introduced for extreme shook models is just one of the 
possible application of RUP to shock models. For example, if we move to a 
more general definition of RUP, in which every urn needs not to be a Polya 
urn, we can obtain several interesting results. For example, we can reproduce 
the urn-based generalized extreme shock model of pp. 

A generalized reinforced urn process, i.e. a generalization of the construction 
in [12], can be obtained using the following ingredients: 



(1) A countable state space V. 

(2) A finite set E of colors, whose cardinality is at least 1. 

(3) For every v G V there exists an urn U(v) characterized by an initial 
composition C(v ) and a reinforcement matrix M(v ). In particular C(v) = 
{n v (c) : c G E} where n v (c) > represents the number of balls of color 
c in U(v ); and M(v) describes how the urn behaves when it is sampled, 
i.e. how balls are replaced or reinforced. 

(4) A function m : V x E — > V that indicates how the process moves from 
state to state, that is from one urn to the other. 



Imagine we are inv&V. We sample the urn U(v) and look at the color c of the 
extracted ball, whose probability of being sampled depends on the composition 
C(v) of the urn. At this point the matrix M(v) says how we have to behave 
(see pQ and [TD] for more details on reinforcement matrices). For example if 
M(v) is the null matrix, it could represent sampling without replacement, so 
that the sampled ball is thrown away. If M(v) is the identity matrix, then we 
consider sampling with replacement. A Polya urn is represented by a diagonal 
matrix having 1 + s, with s > 0, on the main diagonal. And so on for all the 
other possible schemes. At this point the law of motion m says how we move 
form state V\ G V to say state t> 2 G V, i.e. m(vx, c) = v%. 
To clarify the exposition, let us consider the simple model we have introduced 
before. Set {X t } to be our process defined on V. Assume V = {0,1,2,...}, 
E = {b, w} where b means black and w stands for white, C(v) = [w(v),b(v)\ 

\l + s 1 

and M(v) = , s > 0, for every v G V. Moreover the law of 

1 + s 

motion m is such that m(v, b) = and m(v, w) — v + 1. 
For what concerns generalized extreme shock models, as we have seen in [1] 
the authors propose a generalized triangular Polya-like urn, in order to model 
the risky threshold mechanism introduced in [S]. 

It is not difficult to reproduce the results in [1] using the generalized reinforced 
urn process. In fact it suffices to mimic the behavior of the original triangular 
urn using our sequence of urns. The trick is to introduce a recurrence relation 
among the urns in order to imitate the evolution of the urn-based generalized 
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extreme shock model. 

Set V = {0, 1,2, ...} and E = {w,r,b}. For every v G V define the balanced 
matrix 

1 + s 



M = M(v) 



1 + r p 
1 + s 



Assume that the vector representing the initial composition of urn £7(0) is 
C(0) = (ao, &o, Co) and, for every v > 0, set 



C(v) = C(v - 1) + e„_!M, 



:i2) 



where e v is a random vector equal to 



1 



if the ball extracted in U(v) is 



white, 



1 



if red and 



1 

m[v , r 



if black. Furthermore, for the law of motion, 



simply set m(v, w) = m(v, r) = v + 1 and m(v, b) = 0. 
It is effortless to verify that the so-defined urn chain exactly reproduces the 
urn model introduced in [I] , even if in a less intuitive way. As a consequence 
of this, all the results there stated still hold. 



4 Conclusions 



We have seen that extreme shock models are models in which a system is 
subject to random shocks of random magnitude, which make it fail as soon 
as they overcome a certain resistance threshold. Extreme shock models can 
have several applications in material science (as in the simple example we have 
shown) and engineering in general, but also in economics and finance, think 
for example about firms' defaults. 

In this paper we have proposed an alternative modeling based on a special ver- 
sion of the reinforced urn processes introduced by [12]. The main novelty of 
this approach is given by the possibility of performing a Bayesian nonparamet- 
ric analysis of extreme shocks. Given a set of systems subjects to shocks, and 
assuming that they are exchangeable, we have shown how to exploit the infor- 
mation about their history for making predictions concerning default times. 
Moreover, the use of Polya urns for the construction of the model allows the 
researcher to introduce his/her prior knowledge of the phenomena, by modi- 
fying the initial composition of the different urns. 

Possible extensions of the present work could be its development in continuous 
time, on the basis of the main results in [13], and its applications to practical 
problems, such as for example fatigue analysis [H] . Moreover, it could be also 
worth of investigation to work with the general definition of reinforced urn 
processes, introducing for example time- variant reinforcement matrices, in or- 
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der to model other shock models as discussed in [8]. 
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